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Abstract 

Considering that the existing experimental limit for CPT violation is still poor, we explore 
various possible ways to test CPT symmetry in CP-violating B decays at e~^e~ B factories and 
hadron machines. We find that it is difficult to distinguish between the effect of direct CP viola- 
tion and that of CPT violation in the time-integrated measurements of neutral B decays to CP 
eigenstates such as il^Ks and vr^vr^. Instead, a cleaner signal of small CPT violation may appear in 



the time-integrated CP asymmetries for a few non-CP-eigenstate channels, e.g., B^/B^ D^tt^ 
and D^*^^Ks- The time-dependent measurements of CP asymmetries are available, in principle, 
to limit the size of CPT- violating effects in neutral P-meson decays. 
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I. Introduction 



Tests of the fundamental symmetries and conservation laws have been an important topic 
in particle physics. Recently the necessity of testing CPT symmetry has been emphasized by 
several authors [1-3]. On the experimental side, the existing evidence for CPT invariance is 
rather poor. The limit for the strength of CPT- violating interaction in the — system 
is about 10% of that of CP- violating interaction [2-4]. This means that CPT symmetry is 
tested only at the 10% level. On the theoretical side, the universahty of CPT theorem is 
questionable since it is proved in local renormalizable field theory with a heavy use of the 
properties of asymptotic states [5]. This proof may not be applicable for QCD, where quarks 
and gluons are confined other than in a set of asymptotic states [3] . 

The simplest test of CPT invariance is to examine the equahty of the masses and hfetimes 
of a particle and its antiparticle. Beyond the X-meson system, Kobayashi and Sanda are 
the first to suggest some ways to check CPT symmetry in P-meson decays at the future B 
factories [3]. With the assumption that the amplitudes for semileptonic decays satisfy the 
AQ = AP rule and CPT invariance, they relaxed CPT symmetry for the mass matrix of 
the Prf mesons. They found that both P^ — P° mixing and CP asymmetries in neutral P 
decays will get modified if CPT violation is present. A key point of their work is that CP 
asymmetries in nonleptonic B decays such as B^/B^ ipKs may be more sensitive to the 
presence of small CPT- violating effects than the dileptonic decay rates of B^B^ pairs. 

In this work, we shall make an instructive analysis of the effects of CPT violation on CP- 
violating asymmetries in neutral P-meson decays. Both time-dependent and time-integrated 
CP asymmetries are calculated to meet various possible measurements at e~^e~ B factories 
and hadron machines. We suggest several ways for distinguishing CPT violation from direct 
CP violation in B decay amplitudes and indirect CP violation via interference between decay 
and mixing. We show that it is difficult to extract the CPT- violating information from the 
time-integrated measurements of neutral B decays to CP eigenstates such as B^/ B^ ipKs 
and 7r~^7r~ . Instead, cleaner signals of small CPT violation may appear in the time-integrated 
CP asymmetries of some non-CP-eigenstate channels, e.g., B^/B^ D^^n^ and D^*^^Ks. 
Measurements of the time development of P° versus P° decays are available, in principle, to 
limit the size of CPT- violating effects on CP asymmetries. 
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II. Decay probabilities 



We begin with the mass eigenstates of the two mesons [6] : 

1 



\Bi> 

\B2 > 



Vbi|^+ \qi\ 
1 



(pi|S°>+gi|S°>) , 



P2 



> -q^im >) , 



(1) 



^|P2p+ \q2 

where pi 2 and q'l 2 are parameters of the B^B^ mass matrix elements. For convenience, the 

ratios of qi 2 to pi 2 can be further written as 



9i 
Pi 







02 _ 

2 ' p2 - — ' 2 ' 

where 9 and are generally complex [6]. CPT symmetry requires qi/pi — 02/ P2 — e**^ or 
S = cot ^ = 0, and CP invariance requires that both 5 = and = hold. Furthermore, 
the proper-time evolution of an initially (t = 0) pure B^ or is given by 

\B',it)> = e-i^-^^'^y [g4t)\B', > +~g4t)\B', > 

'~g.{t)\B',>+94tm> 



e^'t'cot 
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In Eqs.(3) and (4) we have defined m = (mi -|-m2)/2, F = (Fi -|-F2)/2, Am = m2 — mi, and 
AF = Fi — F2, where mi,2 and Fi^2 are the mass and width of i?i,2 • 

Concentrating only on checking CPT symmetry in the mass matrix of the B^, mesons, here 
we assume that semileptonic B decays satisfy the AQ — AB rule and CPT invariance. We 
also neglect CPT violation in the transition amphtudes for nonleptonic B decays. Relaxing 
these limitations can certainly be done, but the results will become too complicated. To 
obtain simple and instructive results, we further assume that 



AF 



, Im0 = , Im^ = , 



(5) 



and S — cot 9 is small and real. As examined in Ref.[3], large Imcf) and \S\ should be 

measured in the dileptonic decay ratios of B^B^ pairs at the T(4S'). On the other hand, a 



mode-independent analysis shows that AF/F is of the order 0{< 10"^) and has httle effect 
on the time-integrated CP asymmetries in decays [7]. In this work, we proceed with the 
above approximations to calculate the decay probabilities of B*^ and B^ mesons and explore 
the CPT- violating effects on CP asymmetries instructively. The more precise results will 
be presented elsewhere. 

In view of current experiments on 5-meson physics and proposals for future B factories 
[8], we consider two categories of experimental environments for the production and decays 
of neutral B mesons. 

A. Decays of incoherent P° and P° mesons 

In a hadronic production environment [9] or in high energy e~^e~ reactions (e.g., at the 
Z peak), B^ and B^ mesons are produced incoherently. The identification of the flavor of a 
neutral B meson can make use of hadrons produced nearby in phase space [10]. In this case, 
the time-dependent probability for B^ decaying into a hadronic state |/ > is given by 

Pr[S°(t)^/] oc \Af\'e-^^g^{t) + ~g4t)Cf\\ 

Pr[5°(t)^/] oc \Af\'e-^r9-{t) + 9-{t)Cf\\ (6) 



where 



Af ^<f\H\B',>, A^ ^<f\H\B',>, C/ = 4^ ■ (7) 



With the approximations made in Eq.(5), we simplify Eq.(6) as 



Pr[Bl{t)^f] oc |A^|V^*|(l + |Or) + (l-|e/r)cos(Amt) 

2Im^/sin(Ami) V 25Re^/[l - cos(Ami)]| , (8) 

where ^/ = e^'^Q, |^/| — \(f\, and those 0{S'^) terms have been neglected. Integrating 
(-) 

Pr[S° (t) — > /] over t, we obtain the time-independent decay probabihties: 



PriiU /) oc M 



, (9) 



^ -^d -^d 

where Xd = Am/F is a measurable for B^ — B^ mixing. Different from the previous results 
in the literature, here a hnear S term, which implies CPT violation in the B^B^ mass 
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matrix, appears in the decay probabilities. Note that in Ref. [3] = 1 has been taken for 
By — > ipKs- Such an approximation is generally inappropriate (see Sect. III. A), since 
significant direct CP violation may exist in decay amplitdes for many neutral B channels. 

For the case that B^ (5°) decays into |/ >, the CP-conjugate state of \f >, the 
corresponding decay probability PT[B^{t) —>■ f] {PT[B^(t) /]) can be obtained from 
Pr[50(t) ^ /] (Pr[50(t) ^ /]) by the replacements Af ^ Af, (f ^ C/, and ^ , 
where 

Aj ^ < f\H\B', >, Af ^< f\H\Bl >, Cf- ^ ^, Cf- ^ e-%- . (10) 

(-) 

With the same replacements, one can obtain the time-integrated decay probabilities Pr{B^^ 
/) from Eq.(9). 

B. Decays of coherent B^jB^ pairs 

At the T(4S') resonance, the B^s are produced in a two-body [B^B~ and B^B^) state 
with definite charge parity. The two neutral B mesons mix coherently until one of them 
decays. Thus one can use the semileptonic decays of one meson to tag the flavor of the other 
meson decaying into a flavor-nonspecific hadronic final state. The unique experimental 
advantages of studying 6-quark physics in this energy region are well known [11], and both 
symmetric and asymmetric e+e" B factories will be built in the near future on the basis of 
such threshold coUisions [12]. 

The time-dependent wave function for a B^B^ pair produced at the T(45') can be written 

as 

i= [\B',{k, t) > ®1S°(-^, t) > +C\Bl{-k, t) > ®\Bl{k, t) >] , (11) 

where k is the three-momentum vector of the i?^ mesons, and C = ± is the charge parity 
of the B'^B^ pair. Supposing one B^i meson decaying into a semileptonic state \l^X^ > at 
(proper) time ti and the other into a nonleptonic state ]/ > at time t2, the time-dependent 
probabilities for such joint decays are given by 

Pr{l+X-M;fM)c oc \Ai\^\Af\^e-^^'-^'-^ \g+{t{)[g^{h) + Cf9-{t2)] 

+C~g.{t,)[g^{t2) + Cf9+{h)f , 



Pr{l-X+,h-J,h)c « \~g4h)[~g4t2) + Cf9-{t2)] 



[12) 



+Cg.{h)[g+it2) + Cf~9+it2)]\' , 

where Ai =< l+X-\H\B^ >~< l-X+\H\B^ >. By applying Eq.(5), Eq.(6) is further 
simphfied as 

Pr{l^X^,t,;f,h)c oc \Ai\'\Af\'e-^^'^+'-^ {(1 + 1^/1^) T (1 - \if\') cos[Am{h + Ch)] 

±2Im^/ sm[Am{t2 + Cti)] (13) 
±2«SReC/ [C - (1 + C) cos(Amt) + cos[Am(t2 + Cti)]]} , 

Similar to Eq.(8), here a CPT- violating term proportional to S appears. 

Within limits of our present detector technology, we have to consider the feasibility 
for an e'^e~ collider to measure the time development of the decay probabilities and CP 
asymmetries. For a symmetric collider running at the T(45') resonance, the mean decay 
lenth of S's is insufficient for the measurement of (t2 — ^i) [H]- On the other hand, the 
quantity (t2 + ^i) cannot be measured in a symmetric or asymmetric storage ring operating 
at the T(4S'), unless the bunch lengths are much shorter than the decay lengths [11,12]. 
Therefore, only the time-integrated measurements are available at a symmetric B factory. 
Integrating Pt:{I^X^, ti, /, ^2)0 over ti and ^2, we obtain 



Pr(Z±XT,/)_ oc \Ai\'\Af\ 



(14) 



and 



Pr(Z±X^,/)+ oc \Ai\'\Af\ 



1±M ^ J^l4,l^M ± 



2xd 



{1+xir 2 



(1+^1)^ 



SRe^f 



(15) 



+ 

For an asymmetric collider running in this energy region, one might want to integrate Eq.(13) 
only over {t2 + ti) in order to measure the development of the decay probabilities with 
At = {t2 — ti) [11]. In this case, we obtain 



Pr(Z±X^,/;Ai)_ oc IA^HA/I V^l^*' j^^J^ ^ cos(AmAi) 

±Im^/sin(AmAi) ^ 5Re^/[l - cos(AmAi)]} , 



(16) 
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and 

Pr{l^X^,f;AtU oc | A| V^l^^ ^^1^ T ^=i=^^^ cos(AmAt + J 

(17) 

TSRe^f - — ^ ^ cos(AmAt + 0^J 




where (^i)^;^ = tan ^ 



For the case that one neutral B meson decays into \r^X^ > at time ti and the other 
decays into |/ > (the CP-conjugate state of |/ >) at time ^2, the corresponding decay prob- 
abihties Y'x{r^X^,ti]f,t2)c can be obtained from Eq.(13) by the replacements in Eq.(lO). 
In a similar manner, one can obtain ViiV^X"^, f )± and Pr(/^X^, /; At)± straightforwardly 
from Eqs. (14-17). 



III. CP asymmetries and CPT-violating effects 

The difference between the decay probabilities associated with ^ f and B^ ^ f 
is a basic signal for CP violation. For the decays of incoherent B^ and B^ mesons, the 
time-dependent and time-integrated CP- violating asymmetries are defined by 

^^'^ - Pr[i?S(t)-/] + Pr[50(t)^/] ^ ^ 

and 

^ Pr(i?g ^ /) - Pr(B° ^ /) 

- Pr(po ^ /) + Pr(50 ^ /) ' ^ ^ 

respectively. Corresponding to the possible measurements for joint B^B^ decays at sym- 
metric (S) and asymmetric (A) e+e" B factories, we define the CP- violating asymmetries 
as 

,S ^ Pr(/-X+,/)c;-Pr(/+X',/)c 

- Pr(/-X+, f)c + Pr(/+X-, /)c ' ^ ^ 

and 

,A..,^ ^ Pr(/-X+,/;At)c-Pr(/+X-,/;At)c 

-^^^""'^ - Pr(;-X+, /; At)c + Pr(Z+X-, /; At)^ " ^''^ 
In the following, we calculate these asymmetries for two categories of neutral B decays and 

discuss the small CPT-violating effects on them. 
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A. CP-eigenstate decays 



We first consider the and i?^ decays to CP eigenstates (i.e., \f >= ±|/ >) such as 
-0/^5, TT+TT", and TT^Ks- With the phase convention CP\B^ >= > and the approxima- 
tions in Eq.(5), we have — ±Af,A^ — ±Af, — 1/C/, and = For convenience, 
we define three characteristic quantities: 

Nonvanishing U and V imply the CP violation in the decay amplitude and the one from 
interference between decay and mixing [13], respectively W (proportional to S) is a measure 
of CPT violation in the mass matrix of the neutral B mesons. 

For the decays of incoherent B^ and B^ mesons into CP eigenstates, we obtain the CP 
asymmetries: 

A{t) = Ucos{Amt) + Vsin(Ami) + W[l - cos(Ami)] , (23) 



and 



A ^ -^U + -^V+-^W . (24) 



For symmetric and asymmetric e+e collisions at the T(45'), the corresponding CP asym- 
metries in {B^B^)c —>■ {l'^X'^)f are given by 



1 + xl 1 + X? 



and 



A^{At) = U cos(AmAi) + V sin( AmAi) + W[l - cos(AmAi)] , 
1 



A^{At) = ^ ^ [U cos(AmAt J + V sin(AmAt J] 



4 _ a;2 X 

1 y cos(AmAi ^^^J 



(26) 



_4 + ^l ^iT^ 

From the above equations we observe that all the CP asymmetries get modified if CPT 
violation is present. Two remarks are in order. 
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(1) is neither a pure measure of direct CP violation in the decay amplitude (i.e., 
\^f\ 7^ 1) nor that of small CPT violation in the mass matrix, but a combination of both of 
them. If S happens to take the following special value: 

1 IC/P-1 



s 



2x1 



ReO 



(27) 



the effects of CP and CPT violation will completely cancel out in ,4^. In A and A^^, the 
CP asymmetry from the interference between decay and mixing is commonly dominant. A 
combination of measurements of A?_ and A (or A^) can in principle determine V or Im^/ 
unambiguously, as the relations 



V 



{a - A^_) 



2x, 



AS _ I 



(28) 



hold. 



(2) CPT-violating effects can be probed by measuring the time development of the CP 
asymmetries at the T(45') or at a hadronic B factory. With the help of 



A'^iAt) 



1 



--At At + 



Am 



(29) 



the magnitude of W or 5 may be definitely hmited by comparing the data on A^{At) and 
A^{At). In addition, nonvanishing signals of direct CP violation and CPT violation can 
appear on some special points of A{t) and A^{At). For example. 



U 



A 



and 



2-W ^ A 



2n'K\ 
Am) 



2mi 
Am 



+ l)vr 



Ai 



/2n7r 
V Am 



(30) 



= A 



\Am 



+ A. 



Am J 
A , (2n + l)7r' 



Ai 



■(2n + 



1- 



Am 



n 



(31) 



+ Ai 



' (2n-i)7r 
Am 



'rxd 

Am , 



Am Am ^ 
where n = 0, ±1, ±2, and so on. 

It is worthwhile at this point to emphasize that measuring the time- integrated asymmetry 
A?_ for S° versus S° '4>Ks is not so good to probe CPT violation in the mass matrix. 
As discussed in Ref.[14], the so-called hairpin channel may contribute to these two decay 



modes. Thus a small deviation of l^^^s l fron^ unity is possible. With the help of two- loop 
effective weak hamiltonians and factorization approximations, the ratio of hairpin to tree- 
level amplitudes is estimated to be as large as 8% [14]. Therefore, direct CP violation should 
be taken into account when we study the fine effect of CPT violation in B^/B^^ ipKs and 
other neutral B decays. 

B. Non-CP-eigenstate decays 

Now we consider the case that B^ and 5° decay to a common non-CP eigenstate (i.e., 
1/ >^ ±1/ >) but their amplitudes Af {Aj) and Aj {Af) contain only a single weak 
phase. Most of such decays occur through the quark transitions h ^ uc V and cu V 
(with q — d,s), and typical examples are By B^ — > D^^n^ and ^D^*^'^Ks. In this case, no 
measurable direct CP violation arises in the decay amplitudes since \Aj\ = \Af\, \Af \ = \Af\, 
K/l — IC/I) \if \ = IC/I [15]. For convenience, we define 

Note that here a nonzero U does not mean CP violation in the decay amplitude. V_ and 
VV_, which imply indirect CP violation and CPT violation, will contribute to the CP 
asymmetries in this kind of decay modes. 

For the decays of incoherent B^ and B^ mesons, we obtain the time-dependent CP 
asymmetry as follows: 

^ V_ sin(AmO + W_[l - cos(AmO] 
^ ^ 1 + F{Amt) ' ^ ' 

where F is a function defined as 

F{y) = U cosy + V+smy + yV+{l -cosy) . (34) 



In this case, the time-integrated CP asymmetry is given by 

XdV- + xlW. 
l + x'a + U + XdV+ + x'^W^ 
For symmetric and asymmetric e+e~ collisions at the T(4S') resonance, the corresponding 

CP asymmetries in the decay modes in question are given as 



l + xl + U + xjW+ ' 



+ {l + xl)^+{l-xl)U + 2xdV^ + xl{l-xl)W^' 
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and 



V_ sin(AmAt) + >V_[1 - cos(AmAt)] 
1 + F{AmAt) 



V_ sin(AmAt + + >V_ 


^Jl + xl-cos{AmAt + 




^Jl + xl + F{AmAt + (j)^,) + W+ 







(37) 



It should be noted that, in contrast with the asymmetry in B^B^ decays into CP 
eigenstates (see Eq.(25)), here A^ is a pure measure of CPT violation only if Re^f 7^ Re^/. 
There is a handful of neutral B decays, e.g., S° ^yo^*)^^, D(*)±7rT, and ^D^*V, which 
satisfy the conditions \^f\ = |^/| and Re^j 7^ Re^/- Taking B^/ B^ — D^tt^ for example, an 
isospin analysis shows that 



*3/2 



(3J 



where Vij {i — u, c, t;j — d, s, b) are the Cabibbo-Kobayashi-Maskawa matrix elements; 03/2 



^3/2. 



and /2 (ai/2) are the isospin amplitudes for a B^ {B^) decaying into D^n {D 71^^ 



and its CPT-conjugate process [15], and 53/2 and S1/2 are the corresponding strong phases. 
Obviously |^i?-7r+| — ICo+n-l holds, but Cd-tv+ 7^ Cd+-k- because of S3/2 ^ Si/2- As a result, 
measurements of A^ in such decay modes may serve as a good test of CPT symmetry in 
the S-meson decays. 

From Eqs.(35) and (36) we see that A and A^ are also modified in the presence of 
nonvanishing VV_ or S. However, it is difficult to extract any information on CPT violation 
from them. In principle, measurements of the time-dependent asymmetries A{t) and A^{At) 
are possible to probe S with less ambiguity. For example, nonvanishing CPT violation can 

be extracted from 

'(2n + l)7r\ j^f{2n + l)n\ 



A 



Am 



At 



Am 



2W- 

1-U + 2W: 



and 



nn 



Am Am J 
where n = 0, ±1, ±2, and so on. 



>v_ 






yi+ii+(-i)"M+vv+ 





(39) 



(40) 
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IV. Conclusion 

In order to probe the sources oi CP and CPT violation in neutral 5-meson decays, we 
have explored various possible measurements at e+e~ B factories and hadron machines. It is 
shown that CPT- violating effects can in principle be distinguished from direct and indirect 
CP-violating effects, by measuring the time development of CP asymmetries A{t) and A^. 
A clean signal of CPT violation may appear in the time-integrated asymmetries for some 
non-CP-eigenstate decay modes, e.g., B^/B^ D^n^ and D^*^^Ks- In contrast, measuring 
A?_ in the CP-eigenstate decays such as B^/ B^ i^Ks and tt+tt" cannot provide a good 
hmit on CPT violation, since direct CP violation may compete with or dominate over CPT 
violation in them. 

In keeping with the current interest in tests of discrete symmetries and conservation 
laws in the iiT-meson system [16], the parallel approaches are worth pursuing, especially 
on investigating CP violation and checking CPT invariance, for weak decays of B mesons. 
With the development in building high-luminosity B factories [9,11,12], it is possible to ob- 
serve CP (or T) violation in neutral B decays in the near future. The fine effects of CPT 
violation, if they are present, may be probed in the second-round experiments at a P factory. 
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